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Abstract. In this paper, we study the complexity of computing locally optimal solutions for weighted 
versions of standard set problems such as SetCover, SetPacking, and many more. For our inves- 
tigation, we use the framework of VCS, as defined in Johnson et al., [13]. We show that for most of 
these problems, computing a locally optimal solution is already P/I5-complete for a simple natural 
neighborhood of size one. For the local search versions of weighted SetPacking and SetCover, 
we derive tight bounds for a simple neighborhood of size two. To the best of our knowledge, these are 
one of the very few VCS results about local search for weighted standard set problems. 



1 Introduction 

Set Problems and Their Approximation In this paper, we study the complexity of computing 
locally optimal solutions for weighted standard set problems in the framework of VCS, as defined 
in Johnson et al., [13]. In weighted set problems such as SetPacking or SetCover, the input 
consists of a set system along with a weight function on the set system. The task is to compute 
a solution maximizing or minimizing some objective function on the set system while obeying 
certain constraints. Weighted set problems are fundamental combinatorial optimization problems 
with a wide range of applications spanning from crew scheduling in transportation networks and 
machine scheduling to facility location problems. Since they are of such fundamental importance 
on the one hand but of computational intractability on the other hand, [8], the approximation of 
weighted standard set problems has been extensively studied in the literature. Numerous heuristics 
have been applied to or developed for these problems, spanning from greedy algorithms and linear 
programming to local search. 

Local Search and Set Problems Local search is a standard approach to approximate solutions 
of hard combinatorial optimization problems. Starting from an arbitrary feasible solution, a se- 
quence of feasible solutions is iteratively generated, such that each solution is contained in the 
predefined neighborhood of its predecessor solution and strictly improves a given cost function. 
If no improvement within the neighborhood of a solution is possible, a local optimum (or locally 
optimal solution) is found. In practice, local search algorithms often require only a few steps to 
compute a solution. However, the running time is often pseudo-polynomial and even exponential 
in the worst case. 
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rithm Engineering, DFG-Project DA155/31-1, ME872/1 1-1, FI1491 1-1 AVIPASIA and the DFG Research Training 
Group GK-693 of the Paderbom Institute for Scientific Computation. Some of the work was done while the first 
author visited Simon Eraser University. 
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Polynomial Time Local Search Johnson, Papadimitriou, and Yannakakis, [13], introduced the 
class VCS (polynomial- time local search) in 1988 to investigate the complexity of local search 
algorithms. Essentially, a problem in VjCS is given by some minimization or maximization prob- 
lem over instances with finite sets of feasible solutions together with a non-negative cost function. 
A neighborhood structure is superimposed over the set of feasible solutions, with the property that 
a local improvement in the neighborhood can be found in polynomial time. The objective is to find 
a locally optimal solution. The notion of a VCS -reduction was defined in Johnson et al., [13], to 
establish relationships between P>C<S-problems and to further classify them. Not many problems 
are known to be 7^£5-complete, since reductions are mostly technically involved, which seems to 
be in large parts due to the transformation of the neighborhood under the reduction. In the recent 
past, game theoretic approaches re-raised the focus on the class VCS since in many games the 
computation of a Nash Equilibrium can be modeled as a local search problem, [7]. The knowledge 
about VCS is still very limited and not at all comparable with our rich knowledge about J\fV. 

In this paper, we show that for most weighted standard set problems, computing locally op- 
timal solutions is VCS-complete, even for very small natural neighborhoods. This implies that 
computing local optima for these problems via successive improvements may not yield a suf- 
ficient performance improvement over computing globally optimal solutions. Furthermore, we 
believe that most problems investigated in this paper have the potential to serve as candidates for 
the base of future reductions. 

2 Notation and Contribution 

In this section, we describe the notation, complexity classes, and problems considered throughout 
this paper. The fundamental definitions of a VCS-pmhlem and the class VCS were introduced 
by Johnson, Papadimitriou, and Yannakakis, [13]. For all /c G M, denote [k] := {1, . . . , k}, and 
[k]o := [k] U {0}. Given a fe-tuple T, let Pi{T) denote the projection to the i-th coordinate for 
some i £ [k]. For some set S, denote by 2l'^l the power set of S. 

VCS, Reductions, and Completeness, [13] A VCS-problem L = {Dl, Fl, cl, Nl, Init^, Costl, 
Improve^) is characterized by seven parameters. The set of instances is given by Dl C {0, 1}*. 
Every instance I e Dl has a set of feasible solutions Fl{I), where feasible solutions S e Fl{I) 
have length bounded by a polynomial in the length of /. Every feasible solution S G 
has a non-negative integer cost cl{s,I) and a neighborhood Nl{s,I) C Fl{I). lNlTi(/), 
C0STl(s,/), and lMPROVEi:,(s, /) are polynomial time algorithms. Algorithm lNlT/,(/), given 
an instance / G Dl, computes an initial feasible solution s G Fl{I). Algorithm C0STi(s,/), 
given a solution S G Fl{I) and an instance I £ Dl, computes the cost of the solution. Algorithm 
Impr0VEl(s, /), given a solution S G Fl{I) and an instance / G D^, finds a better solution in 
Nl(s, I) or returns that there is no better one. 

A solution S G Fl{I) is locally optimal, if for every neighboring solution s' G Nl{s,I) 
it holds that cl{s' , I) < Ci(s,/) in case L is a maximization P£5-problem and cl(s',/) > 
cl{s, I) in case L is a minimization 'Pi25-problem. A search problem R is given by a relation over 
{0, 1}* X {0, 1}*. An algorithm "solves" R, when given / G {0, 1}* it computes an S G {0, 1}*, 
such that (/, s) G i? or it correctly outputs that such an s does not exist. Given a 7^>C»S-problem 
L, let the according search problem he Rl := {(/, s) | I G Dl,S G Fl{I) is a local optimum}. 
The class VCS is defined as VCS := {Rl | L is a ^£5 -problem}. A Pi25-problem Li is 
VCS-reducible to a 7^>C»S-problem L2 (written Li <pis L2), if there exist two polynomial-time 
computable functions # : D^i 1-^ Dl^ and ^ defined for {(/, s) | / G -Dli,S G ^^2(^(1))} 
with 'F{I,S) G Fl^{I), such that for all / G Dl^ and for all S G Fl^{<P{I)) it holds that, if 
(^(/), S) G Rl2, then (I, ^{I, s)) e Rl^. A VCS-proUem L is VCS-complete if every VCS- 
problem is VCS-reducihle to L. 
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We write limitations to a problem as a prefix and the size of the neighborhood as a suffix. 
For all Pi25-problems L studied in this paper, the algorithms IniTl, Cost^, and IMPROVE^ are 
straightforward and polynomial-time computable. 

2.1 Weighted Standard Set Problems 

We next describe the 7^>C5-problems we study in this paper. All problems we present are local 
search versions of their respective decision problems. In the following, let B denote some finite 
set and let C := {Ci, . . . , C„} denote a collection of subsets over B. Let tt;^ : C i— IN and 
wb : B X B ^ Denote by mg and mc positive integers with < \B\ and mc < \C\. 
Unless otherwise mentioned, we use the k-differ-neighborhood where two solutions are mutual 
neighbors if they differ in at most fc-elements which describe a solution. Except for SetCover, 
all problems are maximization problems. 

Definition 1 (W3DM-(p,q), [6]). / e -Dwsdm of Weighted-3-DimensionalMatching (in 
short W3DMj is a pair (n, w) with n € IN and w is a function w : [n]'^ — > IIl>o- The components 
of triples are identified with boys, girls, and homes. -Fwsdm {I) cire all matchings of boys, girls, 
and homes, i.e. all S C [n]^, with \S\ = n, Pk{Ti) 7^ Pk{Tj), for all Ti,Tj e S, i j, k e [3]. 
For S G -Fw3dm(-^) the cost is Cw3dm(S,/) := X^Tigs^t^(7i)- -^w3DM-(p,q)(5) contains all 
feasible solutions where at most p triples are replaced and up to q boys or girls move to new 
homes. 

Definition 2 (X3C-(k)). / G Dxsc of Exact-Cover-By-3-Sets (in short X3C) is a collec- 
tion C := {Ci, . . . , Cn} of all 3-element sets over a finite set B, with \B\ = 2>qfor some g G M, 
and ii; : C i-> IN. -Fx3c(-f) cire all S C. C such that every b E B is in exactly one Ci G S. For 
S G Fx3cil) the cost is cx3c(S, /) := Y,CieS'^i^i)- 

Definition 3 (SP-(k)). I G Dsp of SetPacking (in short SP) is a triple (C, wc,mc). Fspil) 
areallsetsSC Cwith \S\ < mc.ForSe Fsp{I) the cost is csp^S, I) := Z^CiGSAVjeH jyi:CinCj=0 

Definition 4 (SSp-(Ic)). / G Dssp of SetSplitting (in short SSPj is a tuple (C, wc). Feasible 
solutions Fssp(^) are all partitionings Si,S2'^B ofB. For S G Fssp(-f ) the cost is cssp(S, /) := 
Z^QeCA3sieCi:sie5iA3s2eCi:s2652 '"^(Cj)- 

Definition 5 (SC-(k)). I G -Dsc of SetCover (in short SC) is a tuple (C, wc). Fscil) are all 
subsets S C.C with {JaeS^i = B. For S G Fsc{I) the cost is csc(S, /) := YldeS'^i^i)- 

Definition 6 (TS-(k)). / G -Dts of TestSet (in short TS) is a triple {C,WB,mB). Feasible 
solutions Fts{I) are all sets S C. C with \S\ G [mg]. For S G Fts{I) the cost is cts(S, /) := 

^--ibi,bjEB;i<jABCp,CqES containing exactly one of bi andbj ^j)" 

Definition 7 (SB-(k)). I G Dsb of SetBasis (in short SB) is a triple (C, wc,mc). -Fsb(^) are 
all sets S = {Si, . . . , Sjnc}' where Si G 21^' for all i G [mc]. For S G Fsb{T) the cost is 
CSb{S,I) := J2cieC/\BS'CS:Ci=\Js,^s, Sl'^i^i)- 

Definition 8 (HS-(k)). / G Dus of HittingSet (in short HSj is a triple (C, wcitib). -pHs(-f) 
are all sets S C. B with \ S\ < mg. For S G .Fhs (I) the cost is chs (S, /) := X^Ci6CA3seS-seCi '^(.^i)- 

Definition 9 (IP-(k)). I G Dip of IntersectionPattern (in short IP) are two symmetric 

nxn matrices A = (aij)ije[n] and B = (^ij)ije[n] with positive integer entries and a collection 
V := {Di, . . . , Di} with I > n over a set B. Fip{I) are all vectors C := (Ci, . . . , C„) with 
Ci G Vfor all i G [n]. For S G Fip(I) the cost is cip(S, /) := T.i<jG[n],\CinCj\=aij ^ij- 
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Definition 10 (CC-(l4)). / e Dec of ComparativeContainment (in short CC) are two 
collections C := {Ci, . . . , Cn}, and V := {Di, . . . ,Di} of sets over a set B, and a function 
: C U X> IN. -Fcc(^) are all sets S C B. For S e Fcc{I) the cost is ccc(S,/) := 
^CieC;ScCi ^(.Ci) - J2DieV;SCDi ^i^i) + W, where W > T^Di^v w{Di). 

2.2 Generalized Satisfiability Problems 

The hardness results we present in this paper, rely on known hardness results for the problems 
given below. For all these problems, we use the neighborhood where the value of one variable is 
changed. The task is to compute an assignment maximizing the sum of the weights. 

Definition 11 ((p,q,r)-MCA, [5]). An instance I G -D(p,g,r)-MCA of{p, q, r)-MAXCONSTRAINT- 

ASSIGNMENT is a set of constraints C := {Ci, . . . , Cm} over a set of variables X := {xi, . . . , 
Every constraint Ci{xi-^, .... Xi^,) G C has length at most p and is a function Wd '■ [r]^' 
R>o. Every variable appears in at most q constraints and takes values from [r] with r G IN. 
^mca(^) are all assignments a : X t-^ [r]. The cost of a E -Fmca(^) is Cmca(3, -f) '■= 

^a{x,„...,xi^^)€c wcM^h), • • • > a(xi^J). 

Definition 12 (PosNAE, [17]). An instance I G -Dposnae of PositiveNotAllEqual (in 
short PosNAEj is an instance of (2, *, 2)-MCA. Constraints have length two and return the 
weight wc^ of constraint Ci G C if the two literals in the clause do not have the identical assign- 
ment, otherwise they return 0. 

Definition 13 ((h)-CNFSAT, [14]). An instance I G I?cnfsat of CNFSat is an instance of 
(h, *, 2)-MCA. Constraints are limited to disjunctions of literals over binary variables x E X. 
We drop the prefix if we refer to instances where clauses can have arbitrary length. 

2.3 Related Work 

In this subsection, we mainly present related work about VCS and 'P£5-completeness. The ap- 
proximation of set problems has been intensively studied in the literature, [10-12, 16]. Survey 
articles about local search algorithms can be found in several books, [1,2]. Local search for set 
problems has been applied in numerous papers, [4,9]. For a survey on the quaUty of solutions 
obtained via local search not only for set problems, confer [3] . VCS was defined in Johnson et 
al, [13], and the fundamental definitions and results are presented in [13, 17]. Krentel, [14], shows 
that (/i)-CNFSat is P-C^-complete for some constant /i G IN. Schaffer and Yannakakis, [17], 
show that PosNAE, among numerous other local search problems, is 'P^CiS-complete. The prob- 
lem (p, q, r)-MCA is known to be P£cS-complete for triples (3,2,3), (2,3,8), and (6,2,2), [5, 14]. 
Orlin, Punnen, and Schulz present an FPTAS for computing approximate local optima for every 
linear combinatorial optimization problem in VCS, [15]. The book of Aarts et al, [1], contains a 
list of VCS-complete problems known so far. 

2.4 Our Contribution 

In this paper, we show that for most of the weighted standard set problems given in Subsection 2. 1, 
computing a locally optimal solution is VCS-complete for the 1-differ-neighborhood. This means, 

that the problems are already hard, when one element describing the solution is allowed to be 
added, deleted, or exchanged for another element which is not part of the solution. As our main 
result, we prove the following two theorems: 
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Theorem 1, The problems SSP-(k), TS-(k), US-(k), SB-(k), IP-(k), andCC-{k) are VCS -complete 
for all k > 1. The problems S¥-(k) and SC-(k) are VCS -complete for all k > 2. The problems 
W3DM-(k,l) and X?,C-(k) are VCS -complete for allk>6andl> 12. 

Theorem 2. The problems SP-f 1 ) and SC-( 1 ) are polynomial-time solvable. 

All proofs can be found in Section 3. In Subsection 3.1, we investigate the 'P£5-complexity of 
W3DM-(p, q) and X3C-(A:), in Subsection 3.2, the P/:5-complexity of SP-(A;), in Subsection 3.3 
the P>CiS-complexity of SSp-(A;), in Subsection 3.4, the P>C<S-complexity of SC-(fc), in Sub- 
section 3.5 the 'P£5-complexity of TS-(A;), in Subsection 3.6 the PiZiS-complexity of SB-(fc), 
in Subsection 3.7 the P£5-complexity of HS-(A;), in Subsection 3.8 the P/IcS-complexity of 
IP-(fe), and in Subsection 3.9 the "PZl^-complexity of CC-{k), Let us remark that the reductions 
we present are tight in the sense of Schaffer and Yannakakis, [17]. 

Neighborhoods, Weights, and Hardness. The hardness of a PLS-problems crucially depends on 
both the structure of the neighborhood and the involved weights. On the one hand, if the neigh- 
borhood structure limits the options for improvements in every step such that this can be exploited 
by polynomial time algorithms, then the problems become easy, regardless of the weights. This 
is the case in SP-(l) and SC-(l) where the neighborhood structure can be exploited by a greedy 
algorithm. Interestingly, for all other problems we investigate, the neighborhood structure does 
not interfere with weights in terms of hardness. For most of the problems, this is the case even for 
the smallest possible neighborhood of size 1 . On the other hand, if all weights are polynomially 
bounded then locally optimal solutions can be computed via successive improvements in polyno- 
mial time. All T'-CiS-complete generalized satisfiability problems we reduce from were proven to 
be 7^£<S-compIete via tight reduction and the involved weights are of exponential size. We incor- 
porate these weights in our reductions, preserving their overall structure. Usually, we introduce 
additional weights which are not part of the input problem. They belong to auxihary gadgets that 
are specific to the reduction. The weights involved are either of size one or such that a single 
weight exceeds the sum of all weights in the original problem. 

The General Technique of Our Reductions. As with most reductions in VCS, [5, 17], our re- 
ductions for hardness results consist of two parts: In one part, we encode the input problem / in 
the reduced instance ^(I) in a rather direct manner, while preserving the structure of the orig- 
inal weights. In the other part, which is specific to the reduction and represents a large part of 
our contribution, we introduce auxiliary gadgets that enforce a particular structure in local op- 
tima. Eventually, these gadgets ensure that locally optimal solutions in #(/) indeed correspond to 
locally optimal solution in /. Our proofs also consist of two parts: 

1. First, we show that all feasible solutions which are locally optimal for ^(/) use the gadgets 
as intended, thereby uncovering the structure of locally optimal solutions. Depending on the 
reduction, we call these solutions standard solutions or to be consistent for some property. 

2. Second, we show that all local optima for #(/) correspond to local optimal for /. Step 1 now 
allows to concentrate on the set of all consistent or standard solutions. 

We want to stress that reducing from (3, 2, r)-MCA is crucial for us to show tight bounds for 
SetPacking and SetCover. Furthermore, we believe that reducing from very restricted but 
7^i25-complete versions of the MAxCONSTRAiNxAssiGNMENT-problem might prove useful for 
establishing that further 7^>CjS-probIems with a small neighborhood are ■p>C»S-compIete. 

To the best of our knowledge, these are are one of the very few VCS results for local search on 
weighted standard set problems, as intensively studied in the literature. Our analysis also unveils 
that the hardness of the problems stems from the combination of a numerical problem on an 
underlying combinatorial problem. 
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3 The P/:5-Complexity of Weighted Standard Set Problems 

In this section, we investigate the complexity of computing locally optimal solutions for the 
weighted standard set problems presented in Section 2.1. 

Preliminaries Denote by {p, q, r)-MlNCA the minimization version of {p, q, r)-MCA. Here, 
results about {p, q, r)-MCA carry over to (p, q, r)-MlNCA. In the following, let integer W G 
M be larger than the sum of all weights in an instance / from problem PosNAE, CNFSat, 
{p, q, r)-MCA or {p, q, r)-MlNCA. In detail, for a given instance of PosNAE or CNFSAT, let 
integer W » J2c eC '^Ci- For a given instance of {p, q, r)-MCA or {p, q, r)-MlNCA, let integer 
^ ^ T^Ci{xi^,...xip.)eC ^a{xi^),...,a{xip.)elr] '^Ci{a{xi^), • • .,a{xip.)). 

3.1 On the Complexity of W3DM-(p,q) and X3C-(k) 

In this subsection, we show that W3DM-(p, q) is 'P£5-complete for all p > 6 and q > 12. Since 
instances of X3C-(fc) are instances of W3DM-(fc) by defining triples as 3-element sets, our 
reduction is also applicable to X3C-(A;) with the same argumentation. This eventually shows that 
X3C-(/c) is VCS-comp\ete for all k > 6. We present the reduction function # and the solution 
mapping iP, which are both slight modifications of a reduction proving that W3DM-(9, 15) is 
"P^C^-complete, presented in [6]. We also use the notation presented therein. 

The Reduction In a nutshell, the main idea is to mimic assignments of variables in a constraint 
with triples possessing the weight of the constraint for the given assignment. An additional gadget 
ensures the consistency for all variable assignments. 

In more detail, given an instance / € ^(3,2,r)-MCA» we construct a reduced instance ^(/) = 
{N,w) G -Cw3DM-(6,i2)' consisting of a positive integer G M and a weight function w : 
[N]^ INT that maps triples to positive integer weights. From [5] it follows that the subclass of 
instances of (3, 2, r)-MCA where every clause has length three and where the set of variables is 
tri-colored such that no clause contains two variables with the same color and all sets of variables 
with a certain color have the same cardinality is 'Pi25-complete. Thus, without loss of generahty, 
we assume that in /, every constraint has length three, every variable appears twice and is colored 
blue, red, or white. The coloring of the variables is such that no clause contains two variables with 
the same color and each subset of variables with a certain color has cardinality | A'|/3. Let a be 
an ordering of C. We define A^:=2-r-|^| + |A'|/3 and introduce the following function w: 



bUi) hUO) 9l(j) h\(j) sf(0) hUC) bl(t) /i?(0) 




(a) Gadget assign(i,a;) for a blue (b) Gadget assign(j, x) for a rec/vari- (c) Gadget assign(£, a;) for a white 
variable x ^ X with i e [r]. able y ^ X with j € [r] variable z € X with £ € [r] 

Fig. 1: Gadgets assign(i, x) for a blue, a red, and a white variable with two large triples (soUd 
triangles) and two medium triples (dashed triangles). 



On the Complexity of Local Search for Weighted Standard Set Problems 



7 



Forcing a consistent assignment We define the three sets 

B :={6f (z) \ xeX,ie [r], s G [2]} U {6^(0) \ x e X is a blue variable, s G [3]}, 
G --{g^ii) \ xeX,ie [r],se [2]}U{g^{0) \ x G is a re^^ variable, s G [3]}, 
H --{h^ii) \xeX,ie [r],s G [2]} U {/if (0) \ xeX is awhite variable, s G [3]}, 

each of cardinality A^. For every blue variable x e X and i G [r], we define gadgets as- 
sign(z, x) consisting of two large triples {bf{0),gf{i), hf{i)) and (^'f fff (0; ^2 (0) of weight 
7W and two medium triples {bf{i),gf{i),h2{i)) and 52 (^)' (0) of weight 3W. We 

depicted a gadget assign(i,.T) in Figure la for some blue variable .x G A' and i G [r]. For 
every red variable y G and j G [r], we define gadgets assign (j, y) consisting of two large 
triples {b\{j),gi{0),h\{j)) and (620)5^2(0)5/^20)) of weight 7W and two medium triples 
{bi{j),gi{j),hl{j)) and (62(^)5 ffO')' ^i(j)) of weight We again depicted a gadget as- 
sign (j, y) in Figure lb for some red variable y G and j G [r]. For every white variable z £ X 
and £ G [r], we define gadgets assign(£, z) consisting of two large triples (6f (£), yf (£), /if (0)) 
and (6f (£) , (^) , /li (0) ) of weight and two medium triples (6f (£) , c/f (£) , /if (£) ) and (6f (£) , gf {£) , /i^ (£) ) 
of weight 3W. We again depicted a gadget assign(^, z) in Figure Ic for some white variable 
z e X aadie [r]. 

Evaluating the assignment Without loss of generality, let a; G -Y, be a blue variable, y e X he 

a red variable, and z E X he a white variable. For every constraint Ci{x, y, z) G C, where, with 
respect to a, variable x appears for the s-th, variable y appears for the t-th time, and z appears for 
the ii-th time, with s, t, ti G [2], we define ^ma// triples (5J(i),g'f(j), /i^(^)) of weight uiCi(i,J,-^) 
for every G [r\. All other triples have weight zero. This terminates the description of the 
reduction function <?(/). 

Standard assignment Extending the definition from [6], we define a standard assignment as a 
feasible solution S G ^w3dm-(6,12)(^(^))' consisting of an assignment part and an evaluation 
part, of the following form: Considering the assignment part, for every blue variable x £ X 
there is some i G [r], such that for all s G [3], large triples {b^ {0) , g^ (i) , {i)) G S. For all 
j G [r],j ^ i, medium triples (5f (j), 5f (j)> ^Kj))' (^f (j)> 5! (j)> ^1 (j)) ^ S. Analogously, 
large and medium triples are present for red and white variables. Considering the evaluation part, 
let x, y,z e X and i,j,£ G [r], such that large triples for x, y, and z in S are from gadgets 
assign(z, x), assign(j, y), and assign(£, z). For every constraint Cp{x, y, z) G C, where x oc- 
curs for the s-th, y occurs for the t-\h time, and z occurs for the ti-th time, with respect to a 
and s,t,u G [3], if a; is a blue variable, y is a red variable, and 2; is a white variable, the triple 
(6?(0, 9't'(j), /iu(^)) € S; analogously for all other colorings of the involved variables. 

Solution Mapping Again extending [6], if S G -^w3DM-(6,12)(^(^)) is a standard assignment, 
then ^{I, S) returns for every blue variable x e Xihe index i e [r], such that {bf (0) ,gf{i),hf{i)) G 
S, for every red variable y G X the index j G [r], such that {b\{j), gf{0), fv({j)) G S, and 
for every white variable z G X the index i G [r], such that (6f (-f), yf (£), /if (0)) G S. If 
S G -^W3DM-(6,12)(^(-^)) is not a standard assignment, then tp'(/, S) returns the feasible solu- 
tion computed by algorithm INIT(3 2,r)-MCA(^)- This terminates the description of the reduction. 

Lemma 1. Every locally optimal solution S G -/^w3dm-(6,12)(^(-^)) « standard assignment. 

Proof. We present the proof for sake of completeness, as it is similar to the proof of Lemma 1 
presented in [6]. Let S G ^w3DM-(6,i2)(^(-f)) be a locally optimal solution. Without loss of 
generaUty, let x G be a blue variable. 
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Roadmap With variable x fixed, the proof splits into three parts: 

1. We first show that there are two large triples (6f (0), 5(f (i), /if (i)) and (62(0)5 ff (i)) ^Ki)) 

S for some i^j G [r\. For every gadget without a large triple, there are two medium triples in 
S. 

2. Second, we prove that the two large triples are on the same gadget. 

3. Finally, we show that the small triples in S are chosen in consistency with the placement of 
the large triples. 

(1); TwoLarge Triples and Two Medium Triples. Assume that w.l.o.g triple {bf{0),gf{i), hi{i)) 
S for every i G [r]. We construct a better solution that contains {bf{0),gf{i),hf{i)) for some 
i € [r]. On gadget assign(i,x), the large triple (6f (0), (/f (i), hf(i)) with weight 7W is built. 
The necessary elements 6f (0), gf{i), and hf{i) are in at most three triples, each of weight at 
most 2W. Thus, we substitute a total of three triples to obtain a strictly better solution. Con- 
sidering the medium triples, assume that there exists some j G [r] such that no large triple 
and not both medium triples from gadget assign(j, x) are in S. Without loss of generality, let 
{bl{j),gl{j),hl{j)) S. On gadget assign(j,x), the medium triple {bf{j),gf {j),mj)) of 
weight 2W is built. The necessary elements are in at most three triples of total weight at most W. 
Thus, we again substitute a total of three triples to obtain a strictly better solution. 




bUi) 9l{^) bliO) bfU) afU) bf{0) 




Gadget assign(i,a:) Gadget assign(j, s) 



Fig. 2: Illustration of the construction of a better solution in (2) from proof of Lemma 1 . 



(2); Two Large Triples On A Single Gadget. Assume that the large triples are placed on two 
different gadgets assign(i,x) and assign(j, .x) for some i,j G [r] with i ^ j. In detail, let 
large triples (6|(0), (0; ^1(0) ^ ^ ^^'^ (^i (0)j Si (i)) ^1 (i)) ^ S. We have depicted this 
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situation in the upper part of Figure 2. Note that by construction, there are no medium triples 
from gadgets assign (i, x) or assign (j, x) in S. We construct a better solution by removing the 
large triple (^f (0), (^f (j), /if (j)) from S. Additionally, on gadget assign(i,x), the large triple 
(6f (0),g'f (i), /if (i)) with weight 7W is built. On gadget assign (j, x), the two new medium 
triples (fef (j), 51 (i), /if (i)) and (^f (i)' sKi)' (i))' ^^'^^ of weight 2W, are built. We have 
depicted the better neighboring solution in the lower part of Figure 2. Elements 6f (0), gf{j), and 
/if (j)) are in given triples. The remaining elements gf{i), hf{i), bf{j), /i|(i), tfO)' fff (j) 
are in at most six triples. Our construction yields an additional two medium triples, each of weight 
2W while all decomposed triples which are not shifted to a different gadget have weight at most 
W. Thus, we replace a total of at most six triples to obtain a solution of strictly higher cost. 

(3); Small Weights. The above two cases show that the assignment part of S is that of a standard 
assignment. In detail, for every variable x £ X, there exists some i € [r] such that the two 
large triples are from the same gadget assign(i,x). For every blue variable x this implies that 
elements bf (i) and (0 i^^t in any large or medium triple; analogously for every red and 
white variable. By construction, for every Cj G C, only one small triple with strictly positive 
weight can be uniquely chosen. Without loss of generality, let x G X be a blue variable with 
s G [2] and i G [r] such that boy 6f (i) is not in any large or medium triple. Without loss of 
generality, let y G be a red variable with t G [2] and j G [r] such that girl gf{j) is not in any 
large or medium triple. Without loss of generality, let z E X he a white variable with u G [2] 
and I G [r] such that home hf^(l) is not in any large or medium triple. Let Cp{x, y, z) G C be 
such that X appears for the s-th time, y appears for the i-th time, and z appears for the u-th 
time with respect to the given ordering a. Assume that S deviates in the evaluation part. Thus, 
elements 6f (i), gfij), and h^{t) are in at most three triples, each of weight zero. By building the 
small triple {bg{i), (j), h^{(.)) of weight wcp{i,j,£), we replace at most three triples to obtain 
a neighboring solution with strictly improved cost. □ 

Lemma 2. (3, 2, r)-MCA <p/, W3DM-(p, q)for allp>Q and q > 12. 

Proof. Assume there exists a feasible solution S G i^w3DM-(6,i2)(^(^)) which is locally optimal 
for ^(/), but is not locally optimal for /. By Lemma 1, S is a standard assignment. This implies 
that ^{I, S) is a legal assignment to all variables x e X. Since ^{I, S) is not locally optimal for 
/, there exists a (w.l.o.g.) white variable z e X from instance / G (3, 2, r)-MCA, which can be 
set from value i G [r] to a value j G [r] such that the objective function strictly increases by some 
z > 0. Let variable z appear in constraints Cp, Cq G C. The neighboring solution of S, where the 
two large triples are on gadget assign (j, z) and all medium triples are on gadgets assign z) for 
all i G [r] and i ^ j, and all small triples are chosen according to the new assignment of value j to 
z improves the cost of S by z by construction. This exchange involves the six triples (*, *, /if (0)), 
(*, *, /i2(0)), (*, *, hf{i)), {*, *, /i2(«)), (*, *, hi{j)), and (*, *, /i^O')). The involved homes are 
/if (i) and /i|(i) from gadget assign (i, z), homes /if (j) and /i|(j) from gadget assign (j, z) and 
homes /if(0) and /i2(0) which are in every gadgets assign(*, z). On gadget assign(i,a;), girl 
g'l(i) and boy 6f (i) move to home /if (i), and girl (7f (i) and boy move to home /i|(i). On 
gadget assign(j, x), girl gf{j) and boy 5f (j) move to home /if (0), and girl and boy 6|(j) 
move to home /i|(0). All boys and girls in small triples move from homes /i^li) and /if (i) to 
respective homes /i^i) and h\{j). Thus, 12 boys or girls move to different homes. For all other 
colors of variables which switch assignment, at most 10 boys or girls move to new homes. □ 

3.2 The Exact Complexity of SetPacking- {k) 

In this subsection, we prove that SP-(A;) is P£5-complete for d\\ k > 2 and polynomial-time 
solvable for k = 1. Given an instance I G £'(3,2,r)-MCA' we construct a reduced instance #(/) = 
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{M-,w) G i^sp-(2)' consisting of a collection A4 of sets over a finite set B, a weight function 
: 1-^ M that maps sets in collection M to positive integer weights, and a positive integer 
m < \M.\. W.l.o.g., we assume that in instance / G -D(3^2,r)-MCA> every constraint Ci e C has 
length 3 and the weight of every non-zero assignment is strictly larger than 1 . Furthermore, we 
assume that every variable x ^ X appears in 2 constraints and takes values from [r]. Additionally, 
we may assume that the variables are ordered by appearance. 

The Reduction In a nutshell, the main idea is to define sets representing assignments of vari- 
ables to values in constraints such that inconsistent assignments intersect. The weight of a set 
corresponds to the weight of the constraint for the variable assignment the set represents. Addi- 
tional intersection-free sets of weight 1 offer a relatively small incentive in situations where sets 
intersect. 

In more detail, we create a reduced instance of SP-(2) with m := \C\. Sets in collection ^A 
are defined on elements from the finite set ;S := {ei,Ci \ i G [m]} U {xj | x G X,i G [r]}. 
Collection M. consists of the following sets: For all i G [m], we introduce sets Cf^ := {ej} 
of weight w{Cf^) := 1 in M.. For every constraint Ci{u,v,w) G C and every assignment 
a,b,c G [r], we introduce sets Cf''^''^ of weight w{C'^'^''^) := wci{a,b,c) in M. Here, set 
^a,b,c 1^.^ ^/^^ ^/ ^ w'^\a,b,ce [r]} and 

, jua ifuEX appears in Cj(n, v, w) for the first time 

\^ui,...,Ua-i,Ua+i,...,Ur otherwise, 

analogously for and w'^. We call an element xj for some variable x G X and asssignment 
j G [r] enclosed in a set from M. due to the first appearance of x direct representative of x. We 
say that a family of sets C*'*'* G is incident to a family of sets C*'*'* G if the clauses 
Ci, Cj G C have a common variable. 

Solution Mapping We call a feasible solution S G Fsp-(2)(^(^)) set-consistent if |S| = m and 
for every i G [m] there is exactly one set C"^'^''^ in S for some a, 6, c G [r], which is pairwise 
disjoint from all other sets in S. For a feasible and set-consistent solution S, function ^{I, S) 
returns for every set C*'*'* G S and every direct-representative of Xj the assignment j to variable 
x G -Y. If S is not set-consistent, then the assignment computed by INIT(3 2,r)-MCA(^) is returned. 

Lemma 3. Every locally optimal solution S G -Fsp.(2)(^(-^)) is set-consistent. 

Proof. Assume there exists a locally optimal solution S' G i^sp-{2) (^(-^)) with |S'| < m. By 
pigeonhole principle and construction of our reduction, this implies that there exists a set C^^ G 
M with j G [m] which is not in S'. Adding C^^ to S' strictly improves the cost of S', since 
by construction C^^ is pairwise disjoint from all sets va M.. A. contradiction to S' being locally 
optimal. 

Assume there exists a locally optimal solution S' G i^sp (2)(^(^)) with |S'| = m and there 
exists an i G [m] such that (1) at least two set cf'^''^, cf''^'-^ are in S' for some a, b, c, d,e, f €^ [r] 
or (2) no set C*'*'* is in S'. First, consider case (1). Note that sets C^'^''^, cf''^'^ G S' are not 
pairwise disjoint, since by construction they both contain element Cj G B. By definition of SP-(A;) 
this implies that they do not contribute to the cost of S'. By pigeonhole principle and construction 
of our reduction there exists a set Cj^ G A4 for some j G [m] which is not in S'. Replacing 

set cf''^'-^ G S' for set Cj^ G A4 strictly improves the cost of S', since w{C'j^) = 1 and 
Cj^ is pairwise disjoint from all sets in M. Set Cf'''''^ may only become pairwise disjoint and 
thus contribute to the cost of S'. A contradiction to S' being locally optimal. Now, consider case 
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(2). Let (7*'*'* g S' be incident to families of sets Co'*'*, Cp'*'*, C^'*'* G A4. From case (1), 
we have that for every j € [m], at most one set C*'*'* € S'. If present in S', assume that sets 

Co'*'* ,Cp*'* ,Cq*'* are in S' for some a,b,c e [r]. Since there does not exist a set C*'*'* G S', 
this implies that there exists a set C^^ G S' for some j G [m]. Exchanging set Cj^ G S' for set 
(ja,b,c g — 1^ gg^g from incident families are not present in S', choose an arbirary value for the 
respective variable — strictly increases the cost of S', since C"' ''^ is pairwise disjoint from all sets 
in S' and w{C^' ''^) > w(C^^). A contradiction to S' being locally optimal. □ 

Lemma 4. (3, 2, r)-MCA <pu SP-{k)forall r G F, A; > 2. 

Proof. Assume there exists a feasible solution S G Fsp.(^2){^{I)) which is locally optimal for 
^(I), but is not locally optimal for I. By Lemma 3, S is set-consistent. This implies that S) 
is a legal assignment of values to variables x & X. Since ^{I, S) is not locally optimal for /, 
there exists a variable x e X from instance I G (3, 2, r)-MCA, which can be set from value 
i G [r] to some value j G [r] such that the objective function strictly increases by some z > 0. 
Let variable x appear in constraints Cp, Cq G C. Exchanging the sets Cp'*'* and Cg'*'* by sets 
Cp*'* and Cp'*'* in S yields a feasible and set-consistent solution and by construction this strictly 
increases the cost of S by z. A contradiction. □ 

Despite the negative result for SP-(A;) for all A; > 2, it is possible to compute a locally optimal 
solution for all instances / G SP-(l) in polynomial time. 

Lemma 5. SP-(l) is polynomial-time solvable. 

Proof. Given an instance I G £>sp-(i)' we use the following algorithm GreedyPacking: Start- 
ing from the feasible solution S := 0, process all sets in M. by weight in descending order and 
add the heaviest yet unprocessed set to S, if it is disjoint from all sets Si G S. In order to prove 
that a solution S G -P'sp-(i) (-^) computed by GreedyPacking is locally optimal, assume that 
GreedyPacking terminated and S is not locally optimal. This implies that there either exists a 
set Si ^ M. that can be added, or a set Sj G S that can be deleted, or exchanged for another set 
Si ^ M. with S(, ^ S. Assume there exists a set Si ^ M. with Si ^ S which can be added to S 
such that the cost strictly improves by some z G IN. This implies that Si is pairwise disjoint from 
all sets from S and thus, GreedyPacking would have included set Si. A contradiction. Assume 
there exists a set Sj G S which can be deleted from S such that the cost strictly improves by 
some z G IN. This impUes that Sj intersects with some set from S and GreedyPacking would 
have not included Sj . A contradiction. Assume there exists a set Sj G S which can be exchanged 
for some set Si e M with Si ^ S such that the cost strictly improves by some z G M. This 
implies that Si is pairwise disjoint from all sets in S \ Sj and has a larger weight than Sj. Thus, 
GreedyPacking would have included Si instead of Sj. A contradiction. □ 

3.3 On the Complexity of SETSPLlTTlNG-(fc) 

In this subsection, we prove that SSp-(A;) is 'P£5-complete for all k > 1. Given an instance 
/ G POSNAE, we construct a reduced instance = {M.,w) G -Dssp-(i) consisting of a 

collection M. of sets over a finite set B and a weight function w : M. ^ that maps sets from 
collection M to positive integer weights. 

The Reduction Since SetSplitting is similar to Hypergraph-2-Colorability, we use a 
direct reduction: From instance /, we define the reduced instance of SSP-(l) over the finite set 
B := X. For every clause C;(.t, y) G C, we introduce sets C^'^^ := {x, y} in A4 and we define 
w{C^^^) := wci. Here, function !?'(/, S) returns for a feasible solution S G Fssp-(i)(^(/)) 
assignment for all variables in S\ and assignment 1 for all variables in ^2. 
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Lemma 6. PosNAE <pis SSP-{k) for all k>l. 

Proof. Assume there exists a feasible solution S G Fssp-(i)(^(^)) which is locally optimal for 
^(/), but is not locally optimal for /. This implies that there exists a variable x ^ X in I which 
can be flipped such that clauses Ci, . . . ,Cj G C now have literals with non-identical assignments, 
clauses Cp, . . . ,Cq G C now have literals with identical assignments and the cost of ^{I, S) 
strictly increases by 2; > 0. By construction, this impUes that in element x e B can switch 
partition and now sets C^^^, . . . , C^^^ G M. are not entirely contained in either Si or S2 and sets 

Cp^^, . . . , Cq^^ G are entirely contained in either Si or 6*2. By definition of w, this strictly 
increases the cost of S by z. Thus, S is not locally optimal. A contradiction. □ 

3.4 The Exact Complexity of SETCoVER-(fc) 

In this subsection, we prove that SC-(A;) is 'Pi25-complete for all > 2 and polynomial- time 
solvable for A; = 1. 

The Reduction In a nutshell, the main idea is to reuse the encoding of variable assignments and 
constraints presented in Subsection 3.2 such that for every consistent assignment of variables to 
values, there exists a covering where no element is covered by two sets of the solution. Shifting 
the weights by a large constant incentivizes dropping sets which double cover elements. 

In more detail, given an instance I G ^(3,2,7) minca» we construct a reduced instance ^(/) = 
(A^jtu) G -Dsc-(2)' consisting of a collection M of sets over a finite set B, and a weight func- 
tion w : M. ^ that maps sets in collection M. to positive integer weights. As in proof of 
Lemma 4, we assume that in instance /, every constraint Cj G C has length 3, every variable 
X ^ X appears in 2 constraints and takes values from [r]. Denote m := \C\. We create a reduced 
instance of SC-(2) over the finite set B := {ci \ i ^ [m]} U {xj | a; G G [r]}. For every 
constraint Cj(u, v,w) G C and every assignment a,b,c e [r], we introduce sets (7"''''"^ of weight 
w{Cf := wciia, b,c) + W in M. Here, sets Cf''''" are defined as in proof of Lemma 4. The 
definition of an incident familiy, a set-consistent solution, and the solution mapping S) is as 
in proof of Lemma 4, except that for a non-set-consistent solution, now the assignment computed 
by lNlT(3_2,r)-MiNCA(-^) is returned. 

Lemma 7. Every locally optimal solution S G ^sc-(2)(^(^)) set-consistent. 

Proof. Assume there exists a locally optimal solution S' G ^sc-(2)(^(^)) with |S'| < m. By 
pigeonhole principle and construction of our reduction, this implies that there exists an element 
Cj G i3 for some i G [m] which is not covered. A contradiction to S' being a feasible solution. 

Assume there exists a locally optimal solution S' G -^sc-(2)(^(-^)) with |S'| > m. By pigeo- 
hole principle, this implies that there are two sets C^'^''^ and cf'^'-^ with total weight at least 2W 
in S for some a, b, c, d,e, f G [r] and i G [m]. Since S' is a feasible solution, there exist sets 
C^'*'*, Cj'*'* , Cf'*'* G S' for some o,p,q G [r] and h,j, I G [m] from families indicent to sets 
(ja,h,c ^ fjd,e,f ^ g/ g^changing the two sets C"'^'*^, cf*^'^ for set C°''^''^ yields a feasible solution 
and strictly decreases the cost of S', since w{C"'^''^) < 2W. A contradiction. □ 

Lemma 8. (3, 2, r)-MiNCA <p/^ SC-{k)forall r G IN, > 2. 

Proof. Assume there exists a feasible solution S G ^sc-(2)(^(^)) which is locally optimal for 
^(/), but is not locally optimal for /. By Lemma 7, S is a set-consistent assignment. This implies 
that S) is a legal assignment of values to variables x G X. Since •?'(/, S) is not locally 
optimal for I, there exists a variable x e X from instance / G (3, 2, r)-MlNCA, which can be 
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set from value i G [r] to a value j G [r] such that the objective function strictly increases by some 
z > 0. Let variable x appear in constraints Cp, Cq G C. Exchanging sets Cp*'* and Cg *'* for sets 
Cp*'* and Cq*'* in S yields a feasible and set-consistent solution and this strictly decreases the 
cost of S by z, by construction. A contradiction. □ 

Despite the negative result for SC-(A;) for all A; > 2, it is again possible to compute a locally 
optimal solution for all instances 7 G SP-(l) in polynomial time. 

Lemma 9. SC-(l) /5' polynomial-time solvable. 

Proof. Given an instance / G -Dsc-(i)' we use the following algorithm GreedyCover: Starting 
from the initial feasible solution S := process all sets in S by weight in descending order and 
remove the heaviest yet unprocessed set if S is still a legal cover of B after the removal. In order 
to prove that a solution S G Fsp-(i)(/) computed by GreedyCover is locally optimal, assume 
that GreedyCover terminated and S is not locally optimal. This implies that there exists a set 
iSj G S that can be deleted or exchanged for another set Sj G M. with Sj ^ S such that the cost 
strictly improves by some z > 0. Assume there exists a set S'j G S which can be removed. This 
implies that S is still a legal cover of B after the removal of Si and thus, GreedyCover would 
have removed set Si as well. A contradiction. Assume there exists a set G S which can be 
exchanged for a set Sj G M. with Sj S. This implies that set Sj of smaller weight covers all 
elements B \ Us(.e(S\Si) elements which are uncovered if Si would be removed from 

S. Since Si has larger weight and after its removal, S is still a legal cover, GreedyCover would 
have deleted Si from S. A contradiction. □ 

3.5 On the Complexity of TestSet-(A;) 

In this subsection, we prove that TS-(A;) is 7^>C<S-compIete for all k > I. Given an instance 
/ G PosNAE, we construct an instance #(/) = {M.,w, m) G I?ts-(i)- Here, #(/) consists of a 
collection M of sets over a finite set i3, a weight function w : A4 x M. that maps tuples of 
elements of B to positive integer weights, and a positive integer m < \M\. 

The Reduction The main idea is on the one hand to encode the assignment of variables to values 
in the choice of singleton sets representing literals in some solution and on the other hand to 
simulate the evaluation of clauses in the weight function w. Additional small incentives reward 
the inclusion of singleton sets whereas medium incentives reward the inclusion of distinct literals 
for variables. 

In more detail, given instance /, we construct the reduced instance of TS-(l) over the finite 
set B := {xo,xi \ x G X}. We set m := \X\ and define M := {{a^o}) {xi} \ x G X}. For 
every clause Ci{x,y) G C, we define w{xo,yi) = w{xi,yo) := Wd + 1 + 1^. For all pairs 
{xi,yi) with Xi,yi e B, i e {0, 1}, Xj / y^, and Xi / yi where there does not exist a clause 
Cj{x,y) G C, we define w{x,y) := W + 1. All other function values of w are defined as 1. 
We call a feasible solution S positive-element-consistent if |S| = m and for every set {xi} G S 
it holds that {xj} ^ S. Here, function <P'(7, S) returns for every feasible and positive-element- 
consistent solution S G ^TS-(i)(^(-^)) the assignment induced by the indices of the elements in 
the sets in S. If S is not positive-element-consistent, the assignment computed by IniTposnae(-^) 
is returned. 

Lemma 10. Every locally optimal solution S G -^^ts-(i)(^(-^)) positive-element-consistent. 

Proof. Assume there exists a locally optimal solution S' G ^ts-(i)(^(^)) with |S'| < m. Since 
by construction |A^| = 2m, there exists a sets {x} G M. with {x} S'. Adding {x} to S' 
increases the cost of S' by at least 1, since w{x, r) > 1 for all r G A contradiction. 
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Assume there exists a locally optimal solution S' G ^ts-(i) (^(^)) with |S'| = m, S' contains 
two sets {xo} G S' and {xi} G S'. By pigeonhole principle, there exist sets {yo} £ M. and 
{yi} E M. with {yo} S' and {yi} S'. Thus, exchanging {xq} for {yo} increases the cost of 
S', since no weight W is lost and the additional weight of w{xi,yo) > W dominates the sum of 
the weights lost due to the removal of {xq}. A contradiction. □ 

Lemma 11. PosNAE <pis TS-{k)forall k>l. 

Proof. Assume there exists a feasible solution S G Fxs-(i)(^(/)) which is locally optimal for 
<P(/), but is not locally optimal for I. By Lemma 10, S is positive-element-consistent. This impUes 
that ^{I, S) is a legal assignment for variables a; G A'. Since ^(L S) is not locally optimal 
for /, there exists a variable x G ^ from instance /, which can be flipped such that clauses 
Ci,...,Cj G C now have literals with non-identical assigimients, clauses Cp, . . . ,Cq e C now 
have literals with identical assignments and the cost strictly increases by 2; > 0. This implies that 
in ^(/), set {x,} G S can be replaced by set {x^} G M. On the one hand, for every variable 
y & X with y / .r which appears in a clause Ci from {Q, . . . , Cj} we have that element yi & S 
and w{xj, yi) := + 1 + W. On the other hand, for every variable z E X with z ^ x which 
appears in a clause Ct from {Cp, . . . , Cq} we have that element G S and w{xj, yi) := W + 1 
by construction. All other pairs of elements of B remain unchanged in S. By definition of w, this 
strictly increases the cost of S by z. Thus, S is not locally optimal. A contradiction. □ 



3.6 On the Complexity of SETBASlS-(fc) 

In this subsection, we prove that SB-(A;) is 'P£5-complete for all k > 1. Given an instance 
/ G (/i)-CNFSat, we construct an instance ^(/) = {M-,w,m) G -Dsb-(i) consisting of a 
collection M of sets over a finite set B, a weight function w : M 1-^ M that maps sets in 
collection M to positive integer weights, and a positive integer m < \M.\. 

The Reduction In a nutshell, the main idea is to encode every satisfying assignment of a clause via 
sets containing the respective literals and possessing the weight of the clause. This is polynomial 
in the size of the input since the length of a clause in / is at most h. For feasible solutions to 
be a collection of singleton sets, we add large incentives to include singleton sets and medium 
incentives to include literals for distinct variables. 

From instance I, we construct a reduced instance of SB-(l) over the finite set B := {x, x \ 
X G X} and we define m := \X\. For every x ^ X, we introduce sets Cf^ := {x}, Cf^ := 
{x} in M. with weight w{C^^) = w{C§^) := 2W. For every x,y e X with x y and 
y 7^ X, we introduce sets C^^ := {x,y}, C|f := {x,y}, C^^ := {x,y}, and C|^^ := 
{x, y} in M which all have weight w{-) = W. We encode every satisfying assignment for 
every clause Q G C by the respective set, define it to possess the weight of clause Ci, and 
add it to A^. In detail, for every clause Ci{xi^, . . . ,Xi^) G C and every satisfying assignment 

(f : {xj^, . . . ,Xii_} 1-^ {0, 1}*'' for Ci, we introduce sets C^ "' in M. with weight 

/ ,^SB[ip(xi,,...,Xi,)]s ^SB[if[xi.,...,Xi,j] t n \ u - \ 1 f \'\ 

w{C- ) := u;c,. Here, C. := {^^'(xij, (^'(x^. ),..., (^'(xij}, 

where ip'{xi) := Xi if Pi{(p{xi^, . . . ,Xi^,)) = 1 and ip'{xi) := x, otherwise. We call a feasible 
solution S single-set-consistent if |S| = m, IS'il = 1 for all Si G S and for every set {xj} G S 
it holds that {xj} S. Here, function ^{I, S) returns for a feasible and element-consistent so- 
lution S G FsB-(i)(^^(/)) for every set {x} G S assignment I for variable x e X and for every 
set {x} G S assignment for variable x G -Y. If S is not single-set-consistent, the assignment 
computed by IniT(/j).cnfsat {I) is returned. 



Lemma 12. Every locally optimal solution S G -FsB-(i) (^(-^ )) single-set-consistent. 
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Proof. Assume there exists a locally optimal solution S' € -^sB-(i) (^(-^)) which contains a set 
Si G S' with \Si\ > 1. Since set Si has cardinality at least two, Si is only used in the union of 
sets which by construction have total weight strictly smaller than 2W. By pigeonhole principle, 
there exists a set {x} G 2l^l which is not in S'. Exchanging set Si for {x} strictly increases the 
cost function. Now, set C^^ can be constructed and w{C^^) is larger than the sum of the weights 
of the sets which cannot be generated any more due to the removal of Si. Thus, S' is not locally 
optimal. A contradiction. 

Assume there exists a locally optimal solution S' G Fsb.(i) (#(/)) and S' contains two sets 
{x}, {x} G S'. By pigeonhole principle, there exists a set {y} G B with {y} ^ S' and {y} S'. 
Thus, by exchanging {x} for {y}, the additional set C^^ can now be constructed. No weight 2W 
is lost due to the exchange operation. Set C^^ has weight W and this dominates the sum of the 
weights of the sets which may not be constructed any more due to the removal of {x}. Thus, the 
cost of S' increased and S' is not locally optimal. A contradiction. □ 

Lemma 13. (^)-CNFSat <pi, SB-{k)forall k>l. 

Proof. Assume there exists a feasible solution S G Fsg.^^) (<?(/)) which is locally optimal for 
<P(/), but is not locally optimal for /. By Lemma 12, S is single-set-consistent. This impUes that 
^{I, S) is a legal assignment for all variables x ^ X. Since ^{I, S) is not locally optimal for I, 
there exists a variable x £ X in (h)-CNFS AT, which can be flipped such that clauses Ci, . . . ,Cj G 
C become satisfied, clauses Cp,...,Cq G C become unsatisfied and the cost strictly increases by 
z > 0. This implies that in <P(I), set {x} G 2l^l can be replaced by set {x} G 21^1 Now, sets 
^SBMxi^,...,xi^)] ^ . . . , c^^M'^h'-'^ik)] g corresponding to the satisfying assignment for the 
respective clauses can be generated by the union of subcollections of sets of S involving {x}, 
and all sets ^^^[^(^h' -.^pJI^ _ ^ ^5Bb(x-,, ,...,x-,,)] ^ ^ ^^^^^^ ^^^^^^ ^^.^^ 

subcollections of sets of S. By definition of w, this strictly increases the cost of S by z. Thus, S 
is not locally optimal. A contradiction. □ 



3.7 On the Complexity of HlTTlNGSET-(fc) 

In this subsection, we prove that HS-(fc) is 7^>C<S-complete for all A; > 1. Given an instance 

/ G CNFSat, we construct an instance = {M-,w, m) G -Djjs-(i) consisting of a collection 
M of sets over a finite set B, a weight function w : M. ^ ^ mapping sets in collection M. to 
positive integer weights, and a positive integer m < \B\. 

The Reduction In a nutshell, the main idea is to encode every clause as some set containing the 
respective literals and possessing the weight of the clause. To ensure consistency, we add large 
incentives to include at least one literal from every variable, but not both. 

In more detail, from instance /, we create a reduced instance of HS-(l) over the finite set 
B := {x,x I x G X} where we define m := For every variable x G A', we introduce sets 

every clause, we introduce a single set possessing 
the weight of the respective clause and the elements of the set correspond to the literals in the 
clause. In detail, for every clause Ci{xi^ , . . . , Xj, ) G C, we introduce sets C^^ := {xi^ ,Xi^} 
in M., and we define w{Cf^^) := Wd- We call a feasible solution S element-consistent if |S| = 
\C\ and for every element x G S it holds that x S. Here, function •?'(/, S) returns for a feasible 
and element-consistent solution S G FHS-(i)(^^(-f)) for every element x G S assignment 1 for 
variable x ^ X and for every element x G S assignment for variable x G .Y. If S is not 
element-consistent, then the assignment computed by IniTcnfsat(^) is returned. 

Lemma 14. For every locally optimal solution, S G Fhs-(i)(^(-^)) element-consistent. 
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Proof. Assume there exists a locally optimal solution S' G i^HS (i)(^(^)) with |S'| < m. Since 
\B\ = 2m, there exists an element x with x ^ S' and x S'. Thus, adding x to S' increases 
the cost of S', since no weight is lost and set w{C^^) is hit. A contradiction. 

Assume there exists a locally optimal solution S' G Fhs-(i)(^(^)) with |S'| = m and S' 
contains two elements x G S' and x G S'. By pigeonhole principle, there exists an element y G i3 
with y S'. Exchanging x for y in solution S' increases the cost of S'. All sets of weight W that 
were previously hit are still hit. Additionally, set Cy^ is now hit and w{Cy^) is larger than the 
sum of all sets that where hit due to the membership of x G S'. A contradiction. □ 

Lemma 15. CNFSat <p/, YiS-{k) for all k>l. 

Proof. Assume there exists a feasible solution S G Fhs-(i)(^(^)) which is locally optimal for 
^(/), but is not locally optimal for /. By Lemma 14, S is element-consistent. This implies that 
^{I, S) is a legal assignment to all variables x ^ X. Since ^{I, S) is not locally optimal for I, 
there exists a variable x G in CNFSAT, which can be flipped such that clauses d, . . . ,Cj G C 
become satisfied, clauses Cp, . . . ,Cg G C become unsatisfied and the cost strictly increases by 
z > 0. This implies that in ^(/), element x G S can be replaced by element x e B and now sets 
C^^, Cf^ G M are hit, and sets C^^ , C^^ e M axe not hit. By definition of w, this 
strictly increases the cost of S by z. Thus, S is not locally optimal. A contradiction. □ 

3.8 On the Complexity of iNTERSECTlONPATTERN-(fc) 

In this subsection, we prove that 1P-(A;) is 7^£5-complete for all k > I. Given an instance / G 
POSNAE, we construct an instance = {A, B, Ai) G -Dxp.(i) consisting of two symmetric 
n X n matrices A := (aij)ije[„], ^ •= (^ii)i,ie[n]' and a collection M. of sets over a finite 
set B. W.l.o.g., we assume that in /, every pair of variables x,y e X occurs in some clause 
Ci{x, y) G C. Furthermore, let a be an ordering of X and let 7a;. denote the number of clauses 
Cj G C variable Xi & X appears in. 

The Reduction In a nutshell, the main idea is for every variable x G to introduce sets of 
identical cardinality for both assignments, but which have distinct cardinality from all other sets. 
These sets contain elements encoding satisfying assignments for all clauses variable x appears in. 
If a clause is satisfied by a given assignment, then the intersection of the two corresponding sets 
has cardinality two. In this case, the weight of the clause is added to the solution. Large incentives 
ensure that, identified by cardinality, the sets for variables are placed in the right position in the 
solution. 

In more detail, let w := l-^l and m := 2\C\. We create a reduced instance of IP-(l) over 
the finite set B := {xf^ \ x E X,i E {0, 1}, x appears in clause Cj G C} U {x\ | x G -Y, z G 

{0,1},/ G [m — 272;.+(T(x)]}. For every variablex G XanAi G {0, 1}, we introduce sets C^^^ in 

Ai, where C^.^ := {xf^ , y?^ \ x appears in clause Cj{x, y) G C}U{x' | / G +^(^)]}- 
Note that by construction, for every x G ^, |C^f | = m + cj(x). In the f x v matrix A for ^{I), 
we define an := m + i for all i G [n] and for all i,j G [n] with i / j, we define aij := 2. 
In the V X matrix B for #(/), we define ha := W for all i G [n] and for all i,j G [n] with 
i 7^ j, we define bij := wc^, where wc^. is the weight of clause Ck{xi,Xj) G C. We say that 
a feasible solution S G Fip.(i) (<?(/)) is position-consistent if for every i G [n], set C^^ on 
position i has cardinality an. Here, function S) returns for a feasible and position-consistent 
solution S G Fip.(i)(<P(/)) for every C^f G S assignment i for variable x G -Y. If S is not 
position-consistent, then the assignment computed by IniTposnae(-^) is returned. 

Lemma 16. Every locally optimal solution S G -Pip.(i) (^(-f )) is position-consistent. 
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Proof. Assume there exists a locally optimal solution S' G Fjp_(i)(<^(/)) which is not position- 
consistent. This impUes that there exists a set C^f G S' on position i G [v] with |C^f | 7^ an. 
Replacing C^f G S' for set C^f G on position i in S with \Cy^\ = an strictly improves the 
cost of S', since bu > X^p<gg[„] bpq and entries bpq are the only terms that may be lost in the 
cost of S' due to the replacement. A contradiction. □ 

Lemma 17. PosNAE \V-{k)forall k > 1. 

Proof. Assume there exists a feasible solution S G Fxp.(i) (<?(/)) which is locally optimal for 
^(/), but is not locally optimal for /. By Lemma 16, S is position-consistent. This implies that 
^{I, S) is a legal assignment of values to variables x e X. Since by assumption, ^{I, S) is not 
locally optimal for I, there exists a variable x <E X in instance / G PosNAE, which can be flipped 
such that clauses Cs{x,y), . . . , Ct{x, z) e C now have literals with non-identical assignments, 
clauses Cp{x,u), . . . ,Cq{x,v) G C G C now have literals with identical assignments and the cost 
strictly increases by z > 0. This impUes that in #(/), set C^^ G S on position a{x) in S can 
be replaced by set C^^ G C. Now, by construction \C^^ n C^^f | = • • • = |C^_^ n Cff | = 2 = 

0-a{x)a{y) = ■■■ = aCT(a;)a(2) and \C^^ H C^f | = • • • = \C^^ H C^f | = / aCT(x)(T{«) = • • • = 

0'cT{x)a{v}- By definition of B, this strictly increases the cost of S by z. Thus, S is not locally 
optimal. A contradiction. □ 



3.9 On the Complexity of COMPARATlVECONTAlNMENT-(fe) 

In this subsection, we prove that CC-(A;) is 'P^CiS-complete for all k > 1. Given an instance 

/ G (/i)-CNFSAT, we construct an instance = {M,Af, w) G -Dcc-(i)- Here, <P{I), consists 
of two collections A4 and M of sets over a finite set B and a weight function w : M. U J\f 
that maps sets from collections MuM to positive integer weights. 

The Reduction In a nutshell, the main idea is to encode every satisfying assignment of a clause via 
sets containing the respective literals and possessing the weight of the clause. This is polynomial 
in the size of the input since the length of a clause in J is at most h. Additionally, we add large 
incentives to exclude both literals of a variable and medium incentives to include literals. 

In more detail, we create an instance of CC-(l) over the finite set B := {x,x \ x G 
X}. For every x G X,we introduce sets X^^ in J\f with w{X^'^) := 2W, where X^'^ := 
{y^y I y ^ ^'iy / x}- This terminates the description of J\f. Now, we define collection 
M. Let Rx := {y,y \ y E X;y ^ x}. For every x G -Y, we introduce sets C^'^ := 
Rx U {x} and Cf^ := R^ U {x] in J\f with w{C'!^^) = w{C^^) := W. Let F^^ := {x,x \ 
X does not appear in Ci} denote the set of all fan-out variables in B which are irrelevant for sat- 
isfying Cj. Extending the technique from proof of Lemma 13, for every clause Ci G C, we 
encode every satisfying assignment for Q by the respective set, add all variables irrelevant for 
satisfying the clause, define it to possess the weight of clause Ci and add it to M. In detail, 
for every clause Ci{xi-^, . . . ,Xi^,) G C and every satisfying assignment ip : {xj^, . . . , Xj^} i-> 
{0,1}^* for Ci, we introduce sets ^('^(^n.-.^ij] ^ ^-^^ ^^^^^ccMxi„...,xi^)]^ _ ^^^^ 

Here, (J^^\■f(''n'■■■'^^k^] _ y {ip'{xi^), . . . , (p'{x~i.), <y?'(xij} where (^'(xj) := Xi if 
Pii^ixi-i^, . . . ,Xi^)) = 1 and (p'{xi) := Xi otherwise. The definition of an element-consistent 
solution S G Fcc-(i)(^(^)) and the function ^{I, S) is as in proof of Lemma 15. 

Lemma 18. Every locally optimal solution S G Fcc-(i)(^(^)) element-consistent. 

Proof. Assume there exists a solution S' G -Fcc-(i)(^(-^)) with |S'| < \B\/2 and S' is locally 
optimal. Thus, there exists an element x e B with x S' and x ^ S'. Adding x to S' increases 
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the cost of S', since now S' ^ . The weight of X^'-^ both dominates the sum of the weights 
lost due to S' 2 C'F'" weights of the remaining sets in M. in which S' is not 

entirely contained any more. A contradiction. 

Assume there exists a solution S' G ^cc-(i)(^(-^)) with |S'| > \B\/2 and S' is locally op- 
timal. By pigeonhole principle there exists an element y G S' with y G S'. Removing y G S' 
increases the cost of S', since, on the one hand, it does not alter any containment of S' in J\f. On 
the other hand, S' C Cy'^ and the weight of w{Cy'~^) = W dominates the sum of the smaller 
weights of sets in in which S' is not entirely contained any more. A contradiction. 

Assume there exists a solution S' G -^cc-(i)(^(^)) with |S'| = \B\/2 and S' contains two 
elements x G S' and x G S', and is locally optimal. By pigeonhole principle, there exists an 
element y ^ B with y S' and y S'. Thus, exchanging x for y increases the cost of S', 
since now S' ^ ^y"^ ™d th^ weight of Xy*-^ dominates both the sum of the weight lost due 
to S' 2 C^^ and the sum of the remaining weights of sets in M in which S' is not entirely 
contained any more. A contradiction. □ 

Lemma 19. (^)-CNFSat <pi, CC-{k)forall k > 1. 

Proof. Assume that there exists a feasible solution S G -^cc-(i)(^(-^)) which is locally optimal 
for but is not locally optimal for I. By Lemma 18, S is element-consistent. This implies that 
^{I, S) is a legal assignment for all variables y ^ X. Since ^{I, S) is not locally optimal for /, 
there exists a variable a; G ^ in (h)-CNFS AT, which can be flipped such that clauses Ci,...,Cj G 
C become satisfied, clauses Cp,...,Cq G C become unsatisfied and the cost strictly increases by 
z > 0. This implies that in element x e S can be replaced by element x e B. Now, S is 
entirely contained in exactly one satisfying assignment encoded in some set G M from each 
family of sets (j^'^^'-'^^^n'-'^^k^^ ^ ^ ^CClipixj-^,...,Xj^)] ^ g entirely contained in 

all sets , , _ ^ ^ccifi^,„...,x,^)] ^ definition ofw, this strictly increases 

the cost of S by z. Thus, S is not locally optimal. A contradiction. □ 
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